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ABSTRACT 

The ma'jor purpose of this study vas to assess the 
behavioral impact of the Aaerican Dental Association's (ADA) Teaching 
and Learning Program, Level 2. A second purpose was *to determine the 
reliability of the Navy Plague Index (NPI) when administered to a 
relatively large sample of elementary school students. The -^Plr which 
has demonstrated validity and reliability over a seven-year » period of 
use when utilized by one deptist on small samples of adults, was used 
for assessment purposes. It was adajinistered bj dentists to 16 
randomly selected fifth grade elemefetar.t glasses .in^a .Uidwest' 
community. A pretest and posttest:. ensign, with .experlaetotai and 
rcontrol groups, was ^utilized' in thef study.* The Nstvy plague Test was 
shown to be an unreliable^ measure of plague indices in this case. Due 
to the unreliability of the instrument, the behavioral aspect of the.- 
ADA'S program could not be evaluated. T^e investigators are presently 
in the process of 'conducting a post-pdst NPI measurement of the same 
subjects rerandomizing th^ dentists in order to distribute the- 
variability of the pla^iie ^measures among the various treatment 
groups. This will provide "an opportunity to determine (1) any 
experimental effects tjiat might have resulted from* the program and 
(2) *which effects remain six months after the students were exposed ^ 
to it. By using a measure of dental health status, this program couTd 
make an important contribution to the validation and evaluation of 
classroom health education experiences. (Xuthor/BD) 
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ost universal prevalence of <lental and oral diseases in coirbi- 
with a lack of appropriate attention to such disorders has resulted 
in a health problem of staggering proportions (8:145). By age two, when^ 
all 20 of the primary teeth have erupted into the oral cavity and are 
functioning, half of the children in the United States have one decayed 
tooth. Upon entering school, the average child has at least three decayed 
teeth, and by age 15 has 11 teeth that are either decayed, i^led, or 
missing. (7:283). 

Although dental' health is being taught in many schools, children 

do not appear to be changing their derrtal health practices. Educators 

. ^ .? ' 

should be concerned with changing behavior of students so that they 

•> r. > 

practice and eventually habitdat^ effect^ d?ntal health procedures. 
Because of the evince of dentaj disease, it is obvious that there 
is a need for effective dental health education programs. Applewhite 
(1:1^83) cites the worldwide prevalence of dental diseases as a constant 

V 

reminder of the practically universal need for effective dentaThea.l th 
education programs in- the schools. , 

The schools in the United States are attended by nearly one- third 
cf ,the nation's population. Therefore, Cental' health education in the 
school setting couTd be .an e>ttremely important component of efforts to ' 
influence preventfye dental i?ehavior (6:212). Haefner (6:212-213) concludes 
that the schools are the best place for instilling preventive dental 
behaviors for two reasons, Pirst, the 'school setting avoids the limitation", 
associated with the dental office: dentists in general have not educa'jed^ 
thsir piottients sufficiently. Secondly, dental hygienists spend less thiin 
30 percent of their time on diet and oral health i^lstruction. . 
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' Another reason for using the schools to promote preventive den^1 ^ 
behavior is that the school setting itself po^^esses several positive 
features in its own right (6:212-213). One of the great assets of the schools 
is the opportunity for coimyni cation with nearly all persons v/ithin the 
entire school age group in an explicitly educational context where learning 
is emphasized and rewarded. Furthermore, continuing educational influ- 
ence can be exerted on the target: audience over a considerable time period. 
The process can begin at an early age when habit patterns are still in 
the'process of being forrr,ed rather than being firmly established and 
resistant to change, as is true of adults. Another advantage is that, 
dental health education can use both mass coinnuni cation and personal 
comnuni cation approaches on the same audience, deriving the maximum 
benefit from e^ch. The^^ol classr^m setting also offers the possibility 
of employing group dynamic^s TrTTnJucing students to take appropriate 
dental health action (6:212-213). 

Even though there have been dental health education programs, few 
have had success in changing behavior or instilling sound dental health 
practices. Counsell (4:39) suggests that the empirical repetition of 
outdated/methods and information leads to boredom and frustration in 
students, and if it does not interfere v;i'th learning, it interferes with 
acceptance of information and the, promotion of changed behaviors. 

, li appears that the behavioral iDbjectives of most educational programs 
'do not match behavior change methods. Cohen and Lucye (3:36) point out 
that few curricula guides and. teacher's manuals match behavior change 
mpt^ods with desired behavior objectives. Educational materials still 
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concentrate on desbribing tooth structure, t^e decay process, and the 
number of teeth. Yet in order to learn to acquire the brushing habit, 
it is not' necessary to know where one's biscuspids are located. 

The 'teaching of desired dental health practices needs to include some 
of the components that will permit effective self -appraisal and self- 
reinforceirent by the student. Educational efforts should involve follow- ^ 
up and reinforcement by the school over tipr.e until the newly acquired 
habit is firmly established (9:491). 

With the State of Illinois now initiating a comprehensive mandated 

/ * 

health education curriculum, it appeared to the investigators that this 
would be an opportune time to test the effectiveness of the new American 
Dental Association's Learning About Your Oral Health curriculum materials. 
A field experiment in dental health represertts a unique opportunity for 
educators to joifl with members of the dental profession not only to promote 
the health and well being of children 4nd. youth but also to help control 
a potentially serious and costly .problem. 

Purpose of the Study 
In February, 1975, the study team received a small grant from the 
Bureau of Dental Health Education of the American Dental Association to 
evaluate the ADA's Learning About Your Oral Health, Level II (Grades 4-6) 
teaching and learning program. The general objectives of the study were to; 

1. Determine the effects of' the program on the knowledge, attitudes; 
and practices of fifth grade elementary students 

2. Develop valid and reliable measures of student- dental health 
knowledge and attitudes ir 
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3. Assess the reliability of the Navy Plaque Index when employed 
by a group of dentists 

4. Determine the program's effectiveness as well as its acceptability 
as judged by administi*ators, teachers i parents, dental pro- 
fessionals, and students 

5( Develop the procedures and. adaptations necessary for establishing 
the oral health program .as an int(gral part of a total health 
education program. 
The major purpdse of this study was to determine if students who were 
exposed to the ADA's oral health educational program would exhibit lovifer 
plaque scores than those not exposed as measured by the Navy Plaque Index 

(NPI). S' 

An. additional consideration involved the Issue of the importance 
of in-service education of teachers with respect to the oral health 
teaching and learning program. In order to assess this particular issuei 
the research team also included in their design an experimental group 
(orientation) that received the educational materials bu^id not receive 
in-service training. Thi's group attended a' brief orientation session 
{two hours) that was devoted, to an examination of the materials. Thus, 
this procedure would enable the investigators to compare the educational 
impact of an intensive in-service education program to one involving 
minimal teacher exposure to the curriculum materials. 

The fina-l objective was to determine the reliability of the Navy 
pfaque Index wh?n it is administered by a group of dentists who, were 
familiar with the instrument. 
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^tethods and Procedures 

Six elementary schools were randomly selected from a total of 13 
schools in a midwestern community containing approximately 60,000 persons; 
A total of 375 fifth grade students participated in the experiment; however 
because of the research design employed, 280 children were administered 
pre- and post-test measures. 

Once the six participating schools v/ere selected, each school was 
randomly assigned to a treatment group. The workshop group (Treatment I) 
consisted of six elementary classroom teachers who received an intensive 
'workshop experience relating to the curriculum materials. All of the 
teachers engaged in the same learning experiences that their ctudents-ffoaVd 
be exposed to during the experimental period. The teachers met with a 
trained workshop leader once a week, two hours each week, for a total 
of ten weeks.^ Teachers, enrol led in -the workshop received one unit of 
graduate credit' from the University of Illinois through the office of 
Continuing Education and Public Service. 

The five classroom teachers in the orientation group (Treatment II) 
■fiVnot participate in the workshop but were exposed to a two-hour 
orientation session concerning the Oral Health curriculum. At the orien- 
tation session, teachers were to review the contents of the curriculum 
and ask any questions concerning the teaching material^, duration of 
lessons, films, and outside source materials. No instruction was presented 
on how to employ* the materials in the classroom. 

The control group (Treatment III) consisted of five fifth grade 
classes representing, two schools that were not exFjSsed to the curriculum 
materials. . ^ ■ 
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The Navy Plaque Index (NPI) was utilized to obtain the plaque indicies 
of the subjects. The NPI is designed to reflect the plaque control 
status of a student and the effectiveness of the student's ability to 
properly perform plaque control procedures (5;43). T^ie instrument yields 
two scores, the NPI score (the highest score for one tooth) and the NPI 
total score (the sum score for all teeth). The NPI total score was 
employed as the measurement' to determine the amount of plaque on the 
subjects* teeth. ' - 

A team of 12 dentists from the Illini Dental Association volunteered 
their services to participate in the study. All dentists were trained 
in tKe use of the NPI in order that their scoring procedureY would be 
consistent. Health education majors from the University were utilized 
to. serve as recorders and stainers for the dentists. The same dentists 
and recorders were used in schools that received both pre- and post- 
test measures. |The time interval between the measures was five weeks. 

Examination stations were establis+ied in each school adjacent to the 
subjects* classroom. Students were first asked to rinse their mouths 
at the water fountain to remove large food particles. The subjects' . 
teeth were then- stained with three drops of an ^erythrycin dye (trace ' ^ • 
solution). The students were instructed to use their tongues to spread 
the solution over all surfaces of their teeth. ^ This was accomplishe^d by 
.having the students run their tongues over the outside surfaces of- the upper 
teeth, then the. lower" and the same for the inside upper and lower teeth. ^ 
Subjects were then asked to rinse lightly with, one mouthful of v/ater. 
The student was then examined by a dentist employing a disposable mouth 
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mirror for .eaqh child. Measurements for six designated teeth (3, 9, 12, 
19, 25, 28) were scored for the facial and lingual surfaces of each tooth, ^ 
The lowest possible score that could be obtained by a subject was zero, 
while the maximum score was 108, 

\ ■ 

Experimental Design and Statistical Analysis 

The Solomon f^our Group Design was utilized in the conduct of this 
study. (See Figure if. Tl^is design was selected .in order to control 
for extraneous factors such as history and maturation, the pre-testing 
intaraction effect, as well as any contemporary effects that may occur 
between the pre- and post-test measurements. 

This design also provides a combination of the pre-test/post-test 
experimental -control design with simple' randomized subjects design. 
Information is provi|ded by the pre-test/post-test procedure and at the 
same time, shows how the experimental condition effects an unpretested ' 
group of subjects (2:247). 

The means and standard deviations of plaque scores were calculated 
for all of the schools in the study. A 1 factor analysis of variance ' 
was conducted on the pre-test scores of schools B, C, and A to determine 
if significant differences between plaque scores existed. 

A 2 factor analysis of variance was run on all schools in the study 
utilizing the post-test plaque scoi^es. The factors considered were training 

(Treatment I, II, or III) and test sequence (pire-test or no pre-test). 

* Ik 

All data was submitted to the Digital Computer Laboratory of the University 
of Illinois for key punching. Analyses Were completed by use of the 
4) SOUPAC and SPSS programs available at ^le University of Illinois, Department 
HioMaaa of Computer Science. f - 
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The mean plaque pre to post test scores for all of the experimental and" con- 
trol ' groups are shown In Figure II. It may be observed that" there is approxi- 
mately a 30 point mean difference between the workshop and cjofitrol group on the 
pre-test scores and an even greater difference is found witp respect to the post- 
test data. It is also evident that post-test mean plaque scores increased when 
it would normally be expected that they would decrease. Additionally, the post- 
plaque mean scores of those groups that were pretested are also divergent. 
Furthermore the workshop and* orientation groups that were not pre- tested appeared 
to have post plaque mean scores different from that of the control group. The 
groups that were pre\tested could be said to be dissimilar with respect to 
their plaque indicies. The differences found in the mean plaque" score? may , 
also have been -due to the' procedures by which the dentists obtained the plaque 
scores. The correlation between the control groups' pre and post-test mean 
plaque score was .12, further suggesting" that a basic inconsistency" in the 
procedures employed by the dentists did actually occur. , ' 

An analysis of variance on the. pre-test scores of schools B, C, and A 
showed that ther-fi were significant differences in mean pre-test pla'pue scores 
between the three groups (Table I). An analysis of variance usin J bra factors 
was run on all ofXhe schools, using only the post-test scores. Tqe fartors 
considered were training and Test Sequence. The results are showp on Table II. 
There were a significant main effects and a significant training X sequence 
interaction. Therefore, the main effects were ignored, and the interaction was 
analyzed for significance. ' . 

A Newman- IJents test of the plaque scores showed a high significance (.01 
level) between 'Workshop (I) and Control (III), between Orientation (II) and - 
Control (III) and between Orientation -(11) and Workshop (I) in both pre-test 
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FIGURE II 



- / MEAN PLAQUE SCORES OF" ALL SCHOOLS 



J 



TEST 
SEQUENCE 



O 



-O 



• WORKSHOP (I) 

□ Q =» ORIENTATION (II) 

A- = CONTROL (III) 



-A 




A 



\ 



"~ - ^ \ 



- □ 

o 



PRE-TEST 



POST-TEST 
- OF GROUPS 
PRE-TESTED 



POST-TEST 
OF -GROUPS 
NOT PRE-TESTEC 



X 



to 

o 
o 

3: 

to 



o 

to 

UJ 

a: 
o 
o 
to 



or 



a: 



O 

to 

to 
>- 

•a: 











& 


¥ 








•si- 




CVJ 


CM 


CM 




• 




• 


0 


CVJ 




ID 


to 





to 



CO 


0 


» in 




ID 


rH 


CO 




m 


rH 


rH 




0 




CVJ 


, • 




• 






CO 




ID 




CJ> 








CVJ 


ID 




CO 


00 






rH 


CVJ 


CVJ t 






CVJ 


CVJ 









to 
to 



o 

CO 
CVJ 

ID 
CTk 
CVJ 



o 
o 

Ul 

UJ 

u. 

u. 
o 

.to 

UJ 
Ul 

CD 



CVJ 



o 
I— 

> 

U« 

o 



o 



O 



0 


0 


0 


CVJ 


00 


CJ> 


ID 


VO 




0 














<o 


0 


CO 


rH 




ID 


* CVJ 


CVJ 


CO 




rH 


C7> 


CVJ-* 


ID' 




CO 


CVJ 




rH 

• rH 


00 

rH 



UJ 



or, 



CD 

z:*^ ui ( 
I— 1 1— I to : 



UJ 

a. 



in 



CVJ 



CVJ 



to 



X Ul 

2: 



Z or 

q: hh ui 

O cC 00 



<: 
o 
to 

Ul 
Of 



C7> 
CVJ 



O 



o 



00 



o 



2: 
to 



ERIC 



14 



\ 



\ 
» 



and post- test scores of those groups that were pre-tested. The effects of the 
workshop coutd -be due to random error. It was evident that an increase from 
the, pre- to post-measurement was due to a change in the criterion measure used , 
by dentists iti evaluation of the Workshop group. In reality the plaque scores . 
should have decreased dug to the treatment effect. The reliability of the • 
instrument (NPI) seems to be a problem when measuring the plaque of the subjects. 
The significance shown in the above analyses may be due to the curriculum or 
the method' in which the plaque score was secured. 

Conclusions 

1. No definitive statement may be made as yet to ascertain the effective- 
ness of the Teaching and Learning Program in its behavioral dimension. The 
investigators are presently "in the process of conducting a post-post NPI 
measurement of the same subjects randomizing the dentists in order to distribute 
the variability of the plaque measures among the various treatment groups. 

This will provide an opportunity to determine any e^erimental effects that 
might have resulted from the program and which effects remain six months after 
the students were exposed lo it. • 

2. The Navy Plaque Index was shown to be an unreliable instrument when 
utilized with a relatively large number of upper elementary level students by 
more than one dentist, due to differences in the level of plaque recorded by 
the dentists. 



1 



Recommendations 

1.^ Other measurements of plaque indices should be considered in future 
studies involving more than several dentists or dentaT hygienists. Consideratic 
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might be given to Green's Oral Hygiene Index brj the pingival Bleeding Index 

li Chi 



dren, although the 
a^ses^ed. 

ve tool, the dentists or 



Tor jneasuring plaque ifi upper elementary -scho( 
reliability of those ^nethods al^o needs to be 

Z. If the NPI is to be employed as an evaluat 
dental hygienists should be randomized throughout tne sampleNn order to minimize 
the subjective nature of the instrument, Additibnajlly, pre-orientation sessions 
should be conducted for personnel administering the instrument to ensure that 
the same standards of scoring are being eroployed.j 
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